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Abstract 

In the hidden measurement formalism that we develop in Brussels we ex- 
plain the quantum structure as due to the presence of two effects, (a) a 
real change of state of the system under influence of the measurement and, 
(b) a lack of knowledge about a deeper deterministic reality of the mea- 
surement process. We show that the presence of these two effects leads to 
the major part of the quantum mechanical structure of a theory describing 
a physical system where the measurements to test the properties of this 
physical system contain the two mentioned effects. We present a quantum 
machine, where we can illustrate in a simple way how the quantum struc- 
ture arises as a consequence of the two effects. We introduce a parameter 
e that measures the amount of the lack of knowledge on the measurement 
process, and by varying this parameter, we describe a continuous evolu- 
tion from a quantum structure (maximal lack of knowledge) to a classical 
structure (zero lack of knowledge). We show that for intermediate values 
of e we find a new type of structure that is neither quantum nor clas- 
sical. We analyze the quantum paradoxes in the light of these findings 
and show that they can be divided into two groups: (1) The group (mea- 
surement problem and Schrodingers cat paradox) where the paradoxical 
aspects arise mainly from the application of standard quantum theory as 
a general theory (e.g. also describing the measurement apparatus). This 
type of paradox disappears in the hidden measurement formalism. (2) 
A second group collecting the paradoxes connected to the effect of non- 
locality (the Einstein-Podolsky-Rosen paradox and the violation of Bell 
inequalities). We show that these paradoxes are internally resolved be- 
cause the effect of non-locality turns out to be a fundamental property of 
the hidden measurement formalism itself. 



'Published as: Aerts, D., 1998, "The hidden measurement formalism: what can be ex- 
plained and where quantum paradoxes remain" , International Journal of Theoretical Physics, 
37, 291. 
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1 Introduction 



Quantum mechanics was originally introduced as a non commutative matrix 
calculus of observables by Werner Heisenberg (Heisenberg 1925) and parallel as 
a wave mechanics by Erwin Schrodinger (Schrodinger 1926). Both structurally 
very different theories, matrix mechanics and wave mechanics could explain 
fruitfully the early observed quantum phenomena. Already in the same year 
the two theories were shown to be realizations of the same, more abstract, ket- 
bra formalism by Dirac (Dirac 1958). Only some years later, in 1934, John Von 
Neumann put forward a rigorous mathematical framework for quantum theory 
in an infinite dimensional separable complex Hilbert space (Von Neumann 1955). 
Matrix mechanics and wave mechanics appear as concrete realizations: the first 
one if the Hilbert space is l 2 , the collection of all square summable complex 
numbers, and the second one if the Hilbert space is L 2 , the collection of all 
square integrable complex functions. The formulation of quantum mechanics in 
the abstract framework of a complex Hilbert space is now usually referred to as 
the 'standard quantum mechanics'. 

The basic concepts - the vectors of the Hilbert space representing the states 
of the system and the self-adjoint operators representing the observables - in 
this standard quantum mechanics are abstract mathematical concepts defined 
mathematically in and abstract mathematical space, and this is a problem for 
the physicists working to understand quantum mechanics. Several approaches 
have generalized the standard theory starting from more physically defined ba- 
sic concepts. John Von Neumann and Garett Birkhoff have initiated one of 
these approaches (Birkhoff and Von Neumann 1936) were they analyze the dif- 
ference between quantum and classical theories by studying the 'experimental 
propositions'. They could show that for a given physical system classical the- 
ories have a Boolean lattice of experimental propositions while for quantum 
theory the lattice of experimental propositions is not Boolean. Similar funda- 
mental structural differences between the two theories have been investigated 
by concentrating on different basic concepts. The collection of observables of a 
classical theory was shown to be a commutative algebra while this is now the 
case for the collection of quantum observables (Segal 1947, Emch 1984). Luigi 
Accardi and Itamar Pitowski obtained a analogous result by concentrating on 
the probability models connected to the two theories: classical theories have 
a Kolmogorovian probability model while the probability model of a quantum 
theory is non Kolmogorovian (Accardi 1982, Pitowski 1989). The fundamental 
structural differences between the two types of theories, quantum and classi- 
cal, in different categories, was interpreted as indicating also a fundamental 
difference on the level of the nature of the reality that both theories describe: 
the micro world should be 'very different' from the macro world. The author 
admits that he was himself very much convinced of this state of affairs also 
because very concrete attempts to understand quantum mechanics in a classi- 
cal way had failed as well: e.g. the many 'physical' hidden variable theories 
that had been tried out (Selleri 1990). In this paper we want to concentrate 
on this problem: in which way the quantum world is different from the clas- 
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sical world. We shall do this in the light of the approach that we have been 
elaborating in Brussels and that we have called the 'hidden measurement for- 
malism'. We concentrate also on the different paradoxes in quantum mechanics: 
the measurement problem, the Schrodinger cat paradox, the classical limit, the 
Einstcin-Podolsky-Rosen paradox and the problem of non-locality. We inves- 
tigate which ones of these quantum problems are due to shortcomings of the 
standard formalism and which ones point out real physical differences between 
the quantum and classical world. 

2 The two Major Quantum Aspects in Nature. 

As we mentioned already in the foregoing section, the structural difference 
between quantum theories and classical theories (Boolean lattice versus non- 
Boolean lattice of propositions, commutative algebra versus non commutative 
algebra of observables and Kolmogorovian versus non Kolmogorovian probabil- 
ity structure) is one of the most convincing elements for the belief in a deep 
difference between the quantum world and the classical world. During all the 
years that these structural differences have been investigated (mostly mathe- 
matically) these has not been much understanding of the physical meaning of 
these structural differences. In which way would these structural differences 
be linked to some more intuitive but physically better understood differences 
between quantum theory and classical theory? 

Within the hidden measurement approach we have been able to identify 
the physical aspects that are at the origin of the structural differences between 
quantum and classical theories. This are two aspects that both characterize the 
nature of the measurements that have to be carried out to test the properties 
of the system under study. Let us formulate these two aspects carefully first. 

We have a quantum-like theory describing a system under investigation if the 
measurements needed to test the properties of the system are such that: 

(1) The measurements are not just observations but provoke a real change of 

the state of the system 

(2) There exists a lack of knowledge about the reality of what happens during 

the measurement process 

It is the lack of knowledge (2) that is theoretically structured in a non Kol- 
mogorovian probability model. In a certain sense it is possible to interpret the 
second aspect, the presence of the lack of knowledge on the reality of the mea- 
surement process, as the presence of 'hidden measurements' instead of 'hidden 
variables'. Indeed, if a measurement is performed with the presence of such a 
lack of knowledge, then this is actually the classical mixture of a set of classi- 
cal hidden measurements, were for such a classical hidden measurement there 
would be no lack of knowledge. In an analogous way as in a hidden variable 
theory, the quantum state is a classical mixture of classical states. This is the 
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reason why we have called the formalism that we are elaborating in Brussels 
and that consists in formalizing in a mathematical theory the physical situations 
containing the two mentioned aspects, the 'hidden measurement formalism'. 



3 Quantum Machine producing Quantum Struc- 
ture 

After we had identified the two aspects (1) and (2) it was not difficult to invent 
a quantum machine fabricated only with macroscopic materials and producing 
a quantum structure isomorphic to the structure of a two dimensional complex 
Hilbert space, describing for example the spin of a quantum particle with spin \ 
(Aerts 1985, 1986, 1987). This quantum machine has been presented in different 
occasions meanwhile (Aerts 1988a,b, 1991a, 1995) and therefore we shall only, 
for the sake of completeness, introduce it shortly here. 

The machine that we consider consists of a physical entity S that is a point 
particle P that can move on the surface of a sphere, denoted surf, with center O 
and radius 1 . The unit-vector v where the particle is located on surf represents 
the state p v of the particle (see Fig. l,a). For each point u £ surf, we introduce 
the following measurement e u . We consider the diametrically opposite point 
—u, and install a piece of elastic of length 2, such that it is fixed with one of its 
end-points in u and the other end-point in —u. 



Fig. 1 : A representation of the quantum machine. In (a) the physical entity P is 
in state p v in the point v, and the elastic corresponding to the measurement e„ is 
installed between the two diametrically opposed points u and —u. In (b) the particle 
P falls orthogonally onto the clastic and stick to it. In (c) the clastic breaks and the 
particle P is pulled towards the point u, such that (d) it arrives at the point u, and 
the measurement e„ gets the outcome o" . 

Once the elastic is installed, the particle P falls from its original place v orthogo- 
nally onto the elastic, and sticks on it (Fig l,b). Then the elastic breaks and the 
particle P, attached to one of the two pieces of the elastic (Fig l,c), moves to one 
of the two end-points u or — u (Fig l,d). Depending on whether the particle P 
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arrives in u (as in Fig 1) or in —it, we give the outcome o" or o 2 to e u . We can 
easily calculate the probabilities corresponding to the two possible outcomes. 
Therefore we remark that the particle P arrives in u when the elastic breaks in 
a point of the interval L\ (which is the length of the piece of the elastic between 
— u and the point where the particle has arrived, or l + cosd) , and arrives in —u 
when it breaks in a point of the interval L 2 (L 2 = L — L\ = 2—Li). We make the 
hypothesis that the elastic breaks uniformly, which means that the probability 
that the particle, being in state p v , arrives in u, is given by the length of L\ 
divided by the length of the total elastic (which is 2). The probability that the 
particle in state p v arrives in — u is the length of L 2 (which is 1 — cosO) divided 
by the length of the total elastic. If we denote these probabilities respectively 
by P(di,p v ) and P(o 2 ,p v ) we have: 

n/ u \ l + cos9 2 6 , 1 - cosO . 2 9 
P{o u 1 ,p v ) = =cos 2 - P{o%,p v ) = =sm 2 - (1) 

These transition probabilities are the same as the ones related to the outcomes 
of a Stern-Gerlach spin measurement on a spin ^ quantum particle, of which the 
quantum-spin-state in direction v = (cos<fisin0, sin(f>sin0 , cos9) , denoted by tp v , 
and the measurement e u corresponding to the spin measurement in direction 
u = (cosf3sina, sinf3sina, cosa), is described respectively by the vector and the 
self adjoint operator of a two-dimensional complex Hilbert space. 

^ = (e-^ 2 cose/2, e^sine/2) H u = X -( ™ sa ^ sina ) (2) 

r v ' ' 1 ' 2 \e %t> sinu cosa J v ; 

We can easily see now the two aspects in this quantum machine that we have 
identified in the hidden measurement approach to give rise to the quantum 
structure. The state of the particle P is effectively changed by the measuring 
apparatus (p v changes to p u or to p_„ under the influence of the measuring 
process), which identifies the first aspect, and there is a lack of knowledge on 
the interaction between the measuring apparatus and the particle, namely the 
lack of knowledge of were exactly the elastic will break, which identifies the 
second aspect. We can also easily understand now what is meant by the term 
'hidden measurements'. Each time the elastic breaks in one specific point A, 
we could identify the measurement process that is carried out afterwards as a 
hidden measurement e„. The measurement e u is then a classical mixture of the 
collection of all measurement : namely e u consists of choosing at random one 
of the and performing this chosen e„. 



4 The Quantum Classical Relation 

First of all we remark that we have shown in our group in Brussels that such 
a hidden measurement model can be built for any arbitrary quantum entity 
(Aerts 1985, 1986, 1987, Coecke 1995a, b,c). However, the hidden measurement 
formalism is more general than standard quantum theory. Indeed, it is very easy 
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to produce quantum-like structures that cannot be represented in a complex 
Hilbert space (Aerts 1986). 

If the quantum structure can be explained by the presence of a lack of 
knowledge on the measurement process, we can go a step further, and wonder 
what types of structure arise when we consider the original models, with a lack 
of knowledge on the measurement process, and introduce a variation of the 
magnitude of this lack of knowledge. We have studied the quantum machine 
under varying 'lack of knowledge', parameterizing this variation by a number 
e £ [0,1], such that e = 1 corresponds to the situation of maximal lack of 
knowledge, giving rise to a quantum structure, and e = corresponds to the 
situation of zero lack of knowledge, generating a classical structure. Other values 
of e correspond to intermediate situations and give rise to a structure that is 
neither quantum nor classical (Aerts Durt Van Bogaert 1992, 1993 and Aerts 
Durt 1994 a,b). We have called this model the e- model and want to introduce 
it again in this paper to explain in which way some of the quantum paradoxes 
are solved in the hidden measurement formalism. 

a) The e-Model 

We start from the quantum machine, but introduce now different types of elas- 
tic. An e, d-elastic consists of three different parts: one lower part where it 
is unbreakable, a middle part where it breaks uniformly, and an upper part 
where it is again unbreakable. By means of the two parameters e <E [0, 1] and 
d G [—1 + e, 1 — e], we fix the sizes of the three parts in the following way. Sup- 
pose that we have installed the e, d-elastic between the points — u and u of the 
sphere. Then the elastic is unbreakable in the lower part from — u to (d — e) • u, 
it breaks uniformly in the part from (d — e) ■ u to {d + e) • u, and it is again 
unbreakable in the upper part from (d + e) • u to u (see Fig. 2). 




Fig. 2 : A representation of the measurement e' u d . The elastic breaks uniformly 
between the points (d— e)u and (d+t)u, and is unbreakable in other points. 

An e u measurement performed by means of an e, d-elastic shall be denoted by 
e u d- We have the following cases: (1) v ■ u < d — e. The particle sticks to the 

lower part of the e, d-elastic, and any breaking of the elastic pulls it down to the 
point — u. We have P € (oi,p v ) — and P <L {o2,p v ) = 1- 
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(2) d — e < v ■ u < d + e. The particle falls onto the breakable part of the 
e, rf-elastic. We can easily calculate the transition probabilities and find: 

P e {o u 1 , Pv ) = ^(v-u-d + e) P £ (o£,p„) = l(d + e-t;-u) (3) 

(3) d + e < v ■ u. The particle falls onto the upper part of the e, (i-elastic, and 

any breaking of the elastic pulls it upwards, such that it arrives in u. We have 
P f -(o^, Pv ) = 1 and P f (o%,p v ) = 0. 

We are now in a very interesting situation from the point of view of the struc- 
tural studies of quantum mechanics. Since the e-model describes a continuous 
transition from quantum to classical, its mathematical structure should be able 
to learn us what are the structural shortcomings of the standard Hilbert space 
quantum mechanics. Therefore we have studied the e-model in the existing 
mathematical approaches that are more general than the standard quantum 
mechanics: the lattice approach, the probabilistic approach and the *-algebra 
approach. 

b) The Lattice Approach 

In this lattice approach exists a well known axiomatic scheme that reduces the 
approach to standard quantum mechanics if certain axioms are fulfilled. For 
intermediate values of e, that is < e < 1, we find that 2 of the 5 axioms 
needed in the lattice approach to reconstruct standard quantum mechanics are 
violated. The axioms that are violated are the weak-modularity and the covering 
law, and it are precisely those axioms that are needed to recover the vector space 
structure of the state space in quantum mechanics (Aerts Durt Van Bogaert 1993 
and Aerts Durt 1994 a,b). 

c) The Probabilistic Approach 

If we take the case of vanishing fluctuations (e = 0), do we obtain the Kol- 
mogorovian theory of probability? This would be most interesting, since then 
we would have constructed a macroscopic model with an understandable struc- 
ture (i.e., we can see how the probabilities arise) and a quantum and a classical 
behavior. We (Aerts 1995) proposed to test the polytopes for a family of con- 
ditional probabilities. The calculations can be found in (Aerts S. 1995) and 
the result was what we hoped for: a macroscopic model with a quantum and a 
Kolmogorovian limit. For intermediate values of the fluctuations (0 < e < 1) 
the resulting probability model is neither quantum nor Kolmogorovian: we have 
identified here a new type of probability model, that is quantum-like, but not 
really isomorphic to the probability model found in a complex Hilbert space. 

d) The *- Algebra Approach 

The *-algebra provides a natural mathematical language for quantum mechan- 
ical operators. We applied the concepts of this approach to the epsilon model 
to find that an operator corresponding to an e measurement is linear if and 
only if e = 1 (Aerts D'Hooghe 1996). This means that for the classical and 
intermediate situations the observables cannot be described by linear operators. 
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Conclusion: Quantum theory and classical theories appear as special cases 
(e = l,e = 0) and the general intermediate case, although quantum-like, cannot 
be described in standard Hilbert space quantum mechanics. 

e) The Measurement Problem and the Schrddingers Cat Paradox 
The result stated in the conclusion means that all the paradoxes of standard 
quantum theory that are due to the fact that quantum theory is used as a 
universal theory, also being applied to macroscopic system, for example the 
measuring apparatus, are not present in our hidden measurement formalism. 
We explicitly have in mind the 'measurement problem' and the 'Schrodinger cat 
paradox'. Indeed, the measurement apparatus should be described by a classical 
model in our approach, and the physical system eventually by a quantum model. 
The problem of the presence of quantum correlations between physical system 
and measuring apparatus, as it presents itself in the standard theory, takes 
a completely different aspect. We are working now at the elaboration of a 
concrete description of the measurement process within the hidden measurement 
formalism (Aerts Durt 1994b). Our result also shows that it is possible in the 
hidden measurement formalism to formulate a 'classical limit', namely as a 
continuous transition from quantum to classical (Aerts Durt van Bogaert 1993). 

5 Non-Locality as a Genuine Property of Na- 
ture 

The measurement problem and paradoxes equivalent to Schrodingcrs cat para- 
dox disappear in the hidden measurement formalism, because standard quantum 
mechanics appears only as a special case, the situation of maximum fluctuations. 
All quantum mysteries connected to the effect of 'non-locality' remain (Einstein 
Podolsky Rosen paradox and the violation of the Bell inequalities). It is even so 
that non-locality unfolds itself as a fundamental aspect of the hidden measure- 
ment approach. This is due to the fact that if we explain the quantum structures 
as it is done in the hidden measurement formalism a quantum measurement has 
two concrete physical effects: (1) it changes the state of the system and (2) it 
produces probability due to a lack of knowledge about the nature of this change. 
With the quantum machine we have given a macroscopic model for a spin mea- 
surement of a spin | particle. If we apply the hidden measurement formalism 
to the situation of a quantum system described by a wave function ip(x), an d 
to a position or a momentum measurement performed on this system, we also 
have the two mentioned effects. For example in the case of a position measure- 
ment: the detection apparatus changes the state of the quantum system, in the 
sense that it 'localizes' the quantum system in a specific place of space, and the 
probabilities that are connected with this measurement are due to the fact that 
we lack knowledge about the specific way in which this localization takes place. 
This means that 'before the detection has taken place' the quantum system was 
in general not localized: it was not present in a specific region of space. With 
other words, quantum systems are fundamentally non-local systems: the wave 
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function ifi(x) describing such a quantum state is not interpreted as a wave that 
is present in space, but as indicating these regions of space were the particle 
can be localized, where J R \ip(x)\ dx is the probability that this localization will 
happen in region R. A similar interpretation must be given to the momentum 
measurement of a quantum entity: the quantum entity has no momentum be- 
fore the measurement, but the measurement creates partly this momentum. In 
(Aerts Durt Van Bogaert 1993) we have calculated the e-situation for a quan- 
tum system described by a wave function ip(x), element of the Hubert space of 
all square integrable complex functions, and we have found the following very 
simple procedure. 




Fig. 3 : A graphical representation of the e situation for a quantum system described 
by a wave function ip{x). Suppose that e£[0,l] is given and <^>(a;)= | V (^c) 1 2 is the 
probability distribution corresponding to i/)(x). We cut, by means of a constant 
function <j>n, a piece of the function <p(x), such that the surface contained in the 
cutoff piece equals e (step 1 of fig 3). We move this piece of function to the x-axis 
(step 2 of fig 3), and then rcnormalizc by dividing by e (step 3 of fig 3). 

Suppose that e is given, and the state of the quantum system is described by 
the wave function ip(x) and 4>{x) is the corresponding probability distribution 
(hence (p(x) = \tp(x)\ 2 ). We cut, by means of a constant function (fin, a piece of 
the function <fi(x) , such that the surface contained in the cutoff piece equals e (see 
step 1 of fig 3). We move this piece of function to the x-axis (see step 2 of fig 3). 
And then we renormalize by dividing by e (see step 3 of fig 3). If we proceed in 
this way for smaller values of e, we shall finally arrive at a delta- function for the 
classical limit e->0, and the delta- function is located in the original maximum 
of the quantum probability distribution. We want to point out that the state 
ip(x) of the physical system is not changed by this e-procedure, it remains always 
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the same state, representing the same physical reality. It is the regime of lack 
of knowledge going together with the detection measurement that changes with 
varying e. For e = 1 this regime is one of maximum lack of knowledge on the 
process of localization, and this lack of knowledge is characterized by the spread 
of the probability distribution <f)(x). For an intermediate value of e, between 1 
and 0, the spread of the probability distribution has decreased (see fig3) and for 
zero fluctuations the spread is 0. 

Let us also try to see what becomes of the non-local behavior of quantum 
entities taking into account the classical limit procedure that we propose. Sup- 
pose that we consider a double slit experiment, then the state p of a quantum 
entity having passed the slits can be represented by a probability function p(x) 
of the form represented in Fig 4. We can see that the non-locality presented by 
this probability function gradually disappears when e becomes smaller, and in 
the case where p(x) has only one maximum finally disappears completely. 




Fig. 4 : A representation of the probability distribution corresponding to the state 
of a quantum system that has passed a double slit. We show the three different steps 
of the e procedure (Fig 3) in this case. 

When there are no fluctuations on the measuring apparatus used to detect the 
particle, it shall be detected with certainty in one of the slits, and always in 
the same one. If p(x) has two maxima (one behind slit 1, and the other behind 
slit 2) that are equal, the non-locality does not disappear. Indeed, in this case 
the limit-function is the sum of two delta-functions (one behind slit 1 and one 
behind slit 2). So in this case the non-locality remains present even in the 
classical limit. If our procedure for the classical limit is a correct one, also 
macroscopic classical entities can be in non-local states. How does it come that 
we don't find any sign of this non-locality in the classical macroscopic world? 
This is due to the fact that the set of states, representing a situation where the 
probability function has more than one maximum, has measure zero, compared 
to the set of all possible states, and moreover these states are 'unstable'. The 
slightest perturbation will destroy the symmetry of the different maxima, and 
hence shall give rise to one point of localization in the classical limit. Also 
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classical macroscopic reality is non-local, but the local model that we use to 
describe it gives the same statistical results, and hence cannot be distinguished 
from the non-local model. 

6 The Violation of Bell Inequalities: Quantum, 
Classical and Intermediate 

It is interesting to consider the violation of Bell's inequalities within the hidden- 
measurement formalism. The quantum machine, as presented in section 3, de- 
livers us a macroscopic model for the spin of a spin ^ quantum entity and 
starting with this model it is possible to construct a macroscopic situation, us- 
ing two of these models coupled by a rigid rod, that represents faithfully the 
situations of two entangled quantum particles of spin | (Aerts 1991b). The 'non- 
local' element is introduced explicitly by means of a rod that connects the two 
sphere-models. We also have studied this EPR situation of entangled quantum 
systems by introducing the e- variation of the amount of lack of knowledge on the 
measurement processes and could show that one violates the Bell-inequalities 
even more for classical but non-locally connected systems, that is, e = 0. This 
illustrates that the violation of the Bell-inequalities is due to the non-locality 
rather then to the indeterministic character of quantum theory. And that the 
quantum indeterminism (for values of e greater than 0) tempers the violation of 
the Bell inequalities (Aerts D., Aerts S., Coecke and Valckcnborgh 1996, Aerts, 
Coecke, Durt and Valckcnborgh, 1997a, b). This idea has been used to con- 
struct a general representation of entangled states (hidden correlations) within 
the hidden measurement formalism (Coecke 1996, 1998 and Coecke, D'Hooghe 
and Valckenborgh 1997). 
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